I have published in the Visual Effect menu, a new project call it Hyperreal synthetic humans. Using DeepFake Faces technology, as VFXDigital Compositor, I have replaced his face with another actor. For more information, videos and breakdowns about the project click here.
machine learning
RUNWAY AI GREEN SCREEN
I was commissioned by Runway AI to explore and test their new model call it “Green Screen” and produce 3 videos:
- Space Turbine - Slow MO Train - Ferro Magnetic Warms.
The software is really easy to use and it works on the cloud. You don’t need any fancy workstation or a powerful machine to work on it, just a few clicks on the timeline, isolating the area or object to want to remove and that it. You can see all your footage and elements really clear in your gallery, so you can use it later on. The incredible thing is, it works for rigid elements and organic shapes as you can see in my examples. You can export just the matte (black and white) or change the Background if you need to.The conversion to QT happens really fast and you get an email once you can download the files. At the moment the software support SD, HD, and 4K. In the future more improvements in the interface and edges. If you want more information or to test the software, please visit this link:
https://runwayml.com/
Space turbine
Concept video made with Artificial Intelligence software calls it RUNWAY AI using the model "Green Screen" and "Depth Generator". Compositing using Nuke, Nuke Point Render – Higx and Silk.
space turbine breakdown
slow mo train
RUNWAY AI using the model "Green Screen" and "Depth Generator".
Slow-motion capture using FilMic Pro, 120 frames per second and using the screen model extract all train, and add elements in the background and foreground like other small trains, change the base of the train, smoke, energy effect, etc.
slow mo train breakdown
ferro magnetic warms
RUNWAY AI using the model "Green SCreen"
"Ferro Magnetic Warms", the idea was to video shot Ferro Magnetic liquid in a bottle and make differents takes. To make the warms animation was done with different magneto sizes so the intensity and the speed look completely different shapes. The video was shot in FilMic Pro at HD 60 frames per second and all video was comp in Nuke.
ferro magnetic warms breakdown
Runway ML
in design, film, machine learning
In the last couple of moth, I have been collaborating with one the most incredible project which combines Creativity, Machine Learning and AI. Runwayml it's an App which with a very nice and minimal design, group several models and without any knowledge in code, provide the different solutions for Artist looking for the next Generation of tools.
With a lot of modules where also can be applied to the VFX industry in the near future, which definitely will be more and more integrated into the VFX Pipelines.
Lately, my favorites modules inside of Runwayml are:
DensePose - Facelandmarks - DenseDepth - MaskRCNN - Visual-Importance
My congratulation for the amazing work to Cris, Alejandro, and Anastasis!
Currently now in Beta, you can try your self, here is this link:
